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[57] ABSTRACT 

A digital imaging device captures an image and generates a 
color signal from the image for application to an output 
device having specific color sensitivities, the imaging device 
further being one of many devices of the same type useful 
with the output device. The digital imaging device, for 
cxan^le a digital camera, includes a color sensor for cap- 
turing the image and generating a color signal from the 
captured image, the color sensor having predetermined 
spectral sensitivities, and an optical section that is interposed 
in the image light directed to the color sensor, the optical 
section also having predetermined spectral characteristics. 
The combination of the spectral sensitivities of the color 
sensor and the special ch^cteristics of the optical section 
uniquely distinguish this particular imaging device from 
other imaging devices of the same type. By providing a set 
of matrix coefficients uniquely determined for this imaging 
device, the matrix coefficients optimally correct the spectral 
sensitivities of the color sensor and the spectral character- 
istics of the optical section for the color sensitivities of the 
output device. 

28 Claims, 8 Dra>nng Sheets 
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DIGITAL IMAGING DEVICE OPTIMIZED two sets of CMFs are directly related to each other through 

FOR COLOR PERFORMANCE a unique 3x3 linear transformation, 

■ ^ „ ^^r^^^^^ One practical limitation in the selection of a set of CMFs 

FIELD OFTHE INVENTION f,, the camera is the restriction that they be aU positive. 

This invention pertains to the field of digital imaging and, ^ whereas the CMFs describing a color CRT typically have 

. more particularly, to the optimization of the color perfor- negative lobes. This is not a problem in practice since a 

mance of digital imaging devices* such as digital cameras linear 3x3 transfonnation may t>e employed, as discussed 

and scanners. above, to correct the camera's ou^ut color signals for 

rendition on the CRT display. This linear 3x3 transformation 
BACKGROUND OF THE INVENTION 10 is often referred to in the art as a color-correction matrix. 
Correction matrices are useful in a variety of color Another prartical restriction in the selection of a set of 
imaging applications to effect color conversion or coirec- camera CMF's is the need to minimize the size of the 
tion. For instance, a conversion matrix is used to convert red. off-diagonal coefficients in the color-correction matrix since 
green, and blue video signals into Y amninance) and L Q dirccdy responsible for degrading the noise pcr- 
(chrominance) signals. A color correction matrix is used to formance of the imaging system- 
correct the spectral sensitivities of a video camaa for the The optical path of an electronic camera may consist of 
chromaticitics of the phosphor set of the particular display in various components — each with its own spectral character- 
use. Another use is with film-to-video conversion, a process istics. Among these components one would ordinarily find a 
in which a color correction matrix operates on the film lens, blur-filter, infra-red cut-off filter and a CCD imager, 
scanning signals to canect the film colorimetry for video The overall spectral sensitivity of the camera is determined 
display. While these systems were typically analog systems, by the combined spectral responses of the individual com- 
matrix processing is particularly adapted to a digital envi- ponents. FIG. 1 iliustrates the spectral characteristics for a 
ronment typical color CCD camera including the combined effects of 
Continuing advances in semiconductor technology in ,3 ^ opticsl components. These curves have been 
areas such as digital memory, digital plication-specific normalized to unit response for comparison purposes as is 
integrated circuits (ASICs) and charge-coupled device the standard practice when working with color-matching 
(CCD) imagers have made possible the introduction in functions. 

recent years of digital electronic cameras. Evolution of this Included in FIG. 1 is a second set (dotted lines) of curves 

product segment will be driven by ever increasing consumer 33 representing the transformed spectral characteristics of the 

demands for better performance in such areas as resolution, camera following the colar-couection matrix operation, 

j^otograj^c speed, and color reproduction. In the area of Note diat the transformed spectral responses have negative 

color reproduction it is desirable to select an optimum set of lobes whereas the original camera spectral responses do qol 

spectral characteristics for the CCD imager The prior art FIG. 2 compares the transformed spectral responses of the 

(for example, as described in Color Science in Television 35 camera (dotted lines) with the CMFs for a CRT having COR 

and Display Systems by W. N. Spioson, published by Adam Rec. 709 phosphors and a 6500 Kelvin white point, It can be 

Hilger Ltd, 1983), teaches that one step toward the goal of seen that elements in a real camera have errors in spectral 

good color r^oduction is to choose a set of spectral response that prevent replication of CMFs regardless of the 

characteristics for the camera which are as dose as possible transformation. Errors are normally spread among all colors 

to die spectral characteristics of the intended display device. 40 ^ way that minimizes color errors , but the result inevitably 

In tiie aforementioned Sproson text a color cathode-my tube is not a perfect match, as seen particularly in the transformed 

(CRT) is used as an example of a typical display device camera red spectral response in FIG. 2, 

where the defining spectral characteristics are easily derived The use of a color-correction matrix is shown in U^. Pat 

by someone skilled in the art from a knowledge of the CRT's No. 5,253,047, in which a color temperature detecting 

phosphor chromaticities and whitc-poiDt setting, as well as circuit modifies the matrix coefficients for a primary color 

a knowledge of the spectral response of the human eye. The separator used to perform a color-correction operation for a 

resulting spectral curves are referred to as the color- color video camera. The primary color separator is used to 

matching functions (CMFs) for the display. compute tiie red, green and blue primary color signals for the 

It is desirable to have the camera exhibit spectral sensi- luminance/chrominance signals generated by the camera 
tivities only in the visible portion of electro-magnetic spec- 30 detects circuitry. In U.S. patent application Ser. No. 08/569, 
trum (i^proximately 400 to 700 nm.). In addition, it is 645, "Metiiod and Apparatus for Color-CotTecting Multi- 
desirable that the overall spectral sensitivities of the camera channel Signals of a Digital Camera", filed Dec. 8, 1995 to 
correspond to a set of all-positive color-matching-iunctions Spaulding et al, an improved method is used to select the 
(CMFs). If these requirements are met, the camera will be color-conection matrix coefficients to account for changes 
able to discern color information in the scene in much tiic 55 in illuminant color temperature. In particular, this method 
same way that a human observer does. Failure to achieve provides optimum compensation for variations in the scene 
this goal will result in color reproduction errors. (This failure illuminant by using all of the degrees-Qf-&eedom available 
mechanism is refoxed to as metamerism.) in the primary color separator matrix. 

Asetof spectral curves is defined as a set of CMFs if, and A color-correction matrix is shown in U.S. Pat No. 

only if, it can be exactiy derived from the spectral response 60 5,(X)1,663 as one component of a digital-signal processing 

of the human eye via a linear 3x3 transformation. An infinite chipset for a high performance dlgit^ color video camera, 

number of CMFs are possible according to this definition. The implementation illustrated requires that the matrix be 

The CIE (Commission Internationale De L'Eclairage) has mask-programmed into the chip during fabrication. This 

published standardized spectral data sets describing the approach fixes the matrix coefficients during the production 

response of the human eye. This data may be found in CIE 65 process such that color correction is specific to a defined 

publication 15.2 (1986) Colorimetry—Second Edition in type, or family, of cameras. This is ordinarily done by 

table 2.5. Anotha useful feature of CMFs is the fact that any establishing die matrix coefficients to account for the optical 
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component spectral diaracteiistic or illuminant color tern- BRIEF DESCRIPTION OF THE DRAWINGS 

perature of a defined reference camera, and then embodying . ,. j . . , 

these coefficients in each manufactured camera. FIG. 1 xs a con^son the normalized crigmal camera 

Y, . . ^ . ■ , spectral characteristics and the transformed spectral diarac- 

Pat No 5,189,511 is a fimher example of fliis teristics following application of a color-cooeclion matrix, 

jmproacn, desoibuu mmroved resolution and reproduction * . . . , , , , 

Of hard copies made fromimages captured by diffSent types J^^'^l'J ^^"^^"k^^ transfonncd camera sp^ 

ofdectronicstiUcameras.Subtractive.typeool^ ^ 

is used to attempt to stabilize the primaries associated with Particular UCl. 

image dyes used to produce the hard copy images, preceded ^ ^ ^^^^^ diagram showing the preferred embodi- 

by additive-type processing which atteiripts to correct the lO ^ invention wherein the color matrix is located on 

camera sensitivities appropriately for the stabilized prima- ^® optical assembly of the camera, but the actual color- 

lies. The additive-type color processing may be in the conection operation utilizing the matrix is perfonned exter- 

camera itself to ensure that each ou^ut device achieves °^ ^ the camera. 

optimum color reproduction from signals corresponding to 4 is a block diagram showing a second version of the 

those provided by a defined reference camera. This arrange- preferred embodiment of the invention wherein the color 

ment allows signals from different types of cameras, ie., matrix is located on the optical assembly of the camera and 

corresponding to different defined reference cameras (e.g., color-correction operation is performed internal to the 

high resolution professional cameras vs. low resolution camera. 

consumer cameras), to provide input to different types of FIG. 5 is a block diagram showing a third embodiment of 

hardcopy devices and media. 20 the invention wherein the color matrix is located within the 

As digital cameras and low cost scanners proliferate in the camera but external to the optical assembly of the camera, 

marketplace, there is inaeased need that images from com- FIG. 6 is a block diagram showing a fourth embodiment 

parable cameras or scanners produce con^}arable colors to of the invention ^^erein the lens is removable from the 

the human observer. Unfortunately, small variations in opti- camera. 

cal component spectral characteristics, even within the same ^ FIG. 7 is a block diagram outlining a general method for 

family of cameras, can produce noticeable color differences obtaining the color-conecdon matrix coefficients. 

in die output images. Heretofore, the approaches taJan do piG. 8 is a block diagram of an electronic imaging system 

not account for variations in optical component spectral incorporating an imaging device in accordance with the 

characteristics from individual imaging device to individual invention. 

iimiging device. 

DETAILED DESCRIPTION OF THE 

SUMMARY OF THE INVENTION INVENTION 

The aforementioned problems are solved with a technique Because electronic imaging devices employing electronic 
for optimum color correction utilizing customized matrix 35 sensors are well known, the present description will be 
coefficients for a particular imaging device. According to the directed in particular to elements forming part of, or coop- 
invention, a digital imaging device captures an image and erating more directly with, apparatus in accordance with the 
generates a color signal from the image for application to an present invention. Elements not specifically shown or 
output device having specific color sensitivities, the imaging described herein may be selected from those known in the 
device further being one of many devices of the same type ^ art Certain aspects of the embodiments to be described may 
useful with the output device. ITie digital imaging device, be provided in software. Given the system description as 
for example a digital camera, includes a color sensor for described in the following materials, all such software 
capturing the image and generating a color signal from the implementation is conventional and within tiie oidinaiy skill 
captured image, the color sensor having predetermined in such arts. 

spectral sensitivities, and an optical section tiiat is interposed 45 as understood in the prior art, a digital imaging device is 

in the image Hght directed to die color sensor, tiie optical a device which uses an electronic sensor to capture an image 

section also having predetermined spectral characteristics. either directiy from an object or indirectiy from a medium, 

In^5ortanfly, the combination of the spectral sensitivities of sudj as film; signal processing to represent the captured 

the color sensor and the spectral characteristics of the optical signal numerically; and some storage device to preserve the 

section uniquely distinguish this particular imaging device numerical image data. It is fimher known for a digital 

from other imaging devices ofthe same type. By providing imaging device, particularly a digital camera, to use a 

a set of matrix coefficients uniquely determined for this removable storage device, such as an integrated circuit 

imaging device, the matrix coefficients optimally correct the memory card, to store images. For instance, U.S. Pat No. 

spectral sensitivities of die color sensor and the spectral 5,016,107 describes an electronic still camera utilizing 

diaracteristics of the optical section for the color sensitivi- 55 image compression and providing digital storage in a remov- 

ties of the output device. able memory card having a static random access memory. In 

Besides providing an optimal level of color correction, the this camera, the integrated circuits in the removable memory 

present invention has the advantage that the color reproduc- card store image data and a directory locating the data. The 

tion variation from one camera to the next is accordingly image data provided by the digital imaging device and 

minimi zed. This reduces the occurrence of color nonunifor- 60 stored in a memory card is ordinarily used to produce some 

mity between the same digital images c^tured by different type of display or print, for example, a CRT display or a 

digital cameras. digital print made from images scanned from film or taken 

These and odier aspects, objects, features and advantages by an electronic camera, 

of the present invention will be more clearly understood and As shown in FIG. S, the digital imaging device, which 

appreciated from a review of the following detailed descrip- 65 may be an electronic camera 10 or a scaimer 11, is utilized 

tion of the preferred embodiments and appended claims, and in a system including a digital processor 12. The digital 

by reference to the accompanying drawings. image information produced by die digital imaging device is 
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downloaded to the peripheral digital processor 12, as shown 3 in, for example, the digital processor 12 shown in FIG. 8. 
in FIG. 8, for further processing into a digital image. The Therefore* the RGB signals and the matrix coefficients are 
downloading can be accon^lislied for either device in a provided to the external digital processor 12 via interface 
number of ways, for instance by a cable connection 13 lines 37c and b. In o. second version of the preferred 
through an intaface 14, or by removable media, such as a 3 embodiment of this invention, the color-coirection matrix 40 
memory card 15. through a card reader 16. A suitable color operation is performed internal to the camera as illustrated 
CRT display 17 is connected to the digital processor 12 for in FIG. 4. Where this step is performed is not important to 
displaying the images, and a iffinter 18 is connected to print the teaching of this invention. In either case the color- 
out copies 18fl of the images. A keyt>oard 19 is also correction matrix 40 operation is performed on RGB signals 
connected for use in the processing of the images. The jq which vary linearly with exposure, 
digital processor 12, which can be part of a conventional Color-corrected RGB signals (R^ G^, B^) following the 
programmed coiiq)uter. utilizes conventional processing color-correction matrix 40 operation are converted to a 
techniques to process the digital image information accord- formal suitable for CRT display by a post-processing section 
ing to algorithms stored in the conq)utcr or provided by SO using techniques and components familiar to those 
qrplication software used with the computer. For example, skilled in the art Such post processing operations may 
the digital processor 12 may include a conventional color include such tasks as interpolation, edge-enhancement and 
management system, which links the input device (camera tone-scale remapping, for example. 
10 or scanner 11) and the output device (CRT 17 or printer in the preferred embodiment of tiiis invention as shown in 
18) by utilizing device profiles appropriate for the type of hGS. 3 and 4, the colar-coirection matrix coefficients for 
input and output devices used (e.g., one input profile for the 20 the color matrix operation 40 are stared in a digital memory 
camera 10 and another input profile for the scanner 11). 35 co-located on the optical sub-assembly 20 with all of the 

The ultimate color performance of an electronic camera is other optical con:q)onents. These coefficients are uniquely 

directly influenced by the various optical components which determined for each camera in order to correct the spectral 

con[^}rise the image capture path. It is possible to maximize sensitivities of the particular CCD imager 28 in the camera 

the color reproduction accuracy of a parttcular camera by 25 10, and the spectral characteristics of the particular other 

computing a unique color correction nutrix for that camera elements in the optical subassembly 20» for the color sen- 

which compensates for the unique optical characteristic of sitivities of the type of ou^ut device being used. (For this 

that camera. This approach also minimizes the variation in reason, while representing a specific imaging device, the 

color reproduction firom one camera to the next With coefficients are ordinarily calculated in relation to a refcr- 

reference to FIG. 3, a simpliiied block diagram illustrating 30 ence output device, rather than a specific individual output 

the preferred embodiment of tiie invention is shown. The device.) These coefficients are then applied to the color 

electronic camera 10 has an optical sub-assembly 20 con- matrix operation 40 for color correction of the capture 

taining a lens 22, an infirared cutoff filter 24, a blur filter 26 image. TTiis approach has advantages in the production and 

and a CCD imager 28 with an integral color filter array service environments. In the productioa environment, opti- 

(CFA) 30, The optical subassembly 20 has predetermined 35 cal sub-assemblies 20 can be fabricated, calihrated and 

spectral characteristics, comiHising the combination of the stocked for later integration into the final product 10 without 

spectral sensitivities of the CCD imager 28 and the spectiral the need for calibrating the final product In the service 

characteristics of the lens 22, the infrared cutoff filter 24, and environment, since the optica] subassembly is replaceably 

fee blur filter 26. Due to these spectral sensitivities and interconnected to the pr^ocessing section 34 through the 

^)ectral characteristics, the combination thereof uniquely 40 electrical connecting means 35, optical sub-assemblies 20 

distinguish this imaging device firom other imaging devices can be sinq)ly replaced without the need for calibrating the 

of the same type. In other words, although different cameras repaired product Since each optical subassembly 20 is 

10 contain nominally identical optical elements, induding calibrated for the particular optical components on the 

sensors, their overall spectral responses will differ from subassembly, it may be appreciated tiiat the matrix coeffi- 

camera to camera. 45 cients stored in the memory 36 are unique for each subas- 

The optical subassembly 20, which is used to capture an sembly 20, and therefore for each camera 10. 

image of a scene 32. is designed to be removable from the Note that, although RGB signals have been discussed by 

camera 10 for purposes of servicing and calibration. When way of example as the tristimulus faanst of dioice for 

installed in fee camera, fee optical subassembly electrically representing the scene color ioformarion. this invention is 

connects to a preprocessing section 34 througji an electrical jo not restricted to use with this format alone. Ofeer tristimulus 

connecting means 35. Image-wise signals S^-S^ firom fee formats such as fee CIE XYZ format are equally applicable 

CCD imager 28 are converted to digital, linear RGB format and may, in fact, present advantages in a particular ini^le- 

within fee camera by fee pre-processing section 34 using mentation. Since fee CIE XYZ format is a device indepen- 

tedmiques and components familiar to feosc skilled in fee dent space based on a set of CMFs defined by fee CIE 193 1 

art These digital RGB signals represent fee red, green and 55 Standard Colorimetric Observer (2*), fee matrix coefficients 

blue primary components of fee image, respectivdy. Pre- could be used to generate an input profile unique to each 

processing section 34 may pcrfcffm such well-known tasks camera which will correct fee special sensitivities of fee 

as doublc-ocarelated sampling of the CCD signals, black- camera for fee standardized CMFs of this device indepen- 

Icvd control, white-balance, analog-to-digital conversion. dent space. For example, in one application following fee 

conversion of fee CCD signals to RGB and interpolation of 60 ICC Profile Format Specification (Version 3.2, Nov. 20. 

fee CFA data to jroduce RGB values at each pixd location. 1995. published by fee International Color Consortium), 

Digital RGB values from fee pre-processing section 34 RGB input profiles arc established which will correct fee 

aretransformedtoasetof color-corrected RGB values (R^ spectral sensitivities of an input device for a connection 

Gcc B„-) suitable for display on fee color CRT display 17 by space. Thereupon, output profiles arc used to convert fee 

processing in a color matrix operation 40. In this embodi- 6^ signals from fee connection space to a format that is 

ment of fee invention, fee color-correction matrix 40 opera- expected by an ou^ut device. It should feerefore be under- 

tion is performed external to fee camera as is shown in FIG. stood feat this invention encompasses linear tristimulus 
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formats in general while the discussion is limited to the need to be modified to account for tiie nonlinear character- 
familiar RGB format for ease of understanding. istic of the CRT phosphors. The resulting XYZ signals from 

FIG. 5 illustrates a third embodiment of the invention CRT phosphor transformation matrix 84 rqjresent the repro- 

whcrcin the color-concction matrix coefficients for ttie duccd colors for each color patch of the color chart 72 for a 

matrix operation 40 ait stored in a digital memory 38 5 reference output dc\dce, in this case the reference CKT. 

located somewhere within the camera 10 but not necessarily ^ calculation process 82 determines the average 

on the optical sub-assembly 20. In this embodiment Ac between the aim and reproduction signals for all of the 

aforemcDtioned advantages in the production and service color patches on the color chart 72. An individual color error 

environments are not realizable but the color reproduction computed for each coIot patch using the square-root 

accuracy and consistency goals of the invention are not 10 of the sum of the squares of the differences of the aim and 

compromised. repxxluction X Y and Z signals. This represents the vector 

HG. 6 mustrates a fourth embodiment of the invention .^^T/' l^^^^^^^^he aim and reproduction 

wherein the lens 22 is not physicaUy part of the optical 3-dunensional XYZ color J>ace. m last part 

sub-assembly and may in fact, be rcmo^^lc as is the case calculation is to average the mdxvidual color 

ofacamcra with intcrchangeablclenses. In this situation the ^^^^"^ ^ ^ ""'^^ regression 

camera or optical sub-assembly, depending on where the process »U. • 

color-cocffidcnt matrix digital memory 38 is located, is forcgomg matrix coefficient calculation process has 

calibrated using a lens with a spectral response representing described from the standpoint of obtaining a good 

the average of the spectral responses of aU lenses that are colarimctric match between the original scene and its repro- 

antidpated to be used with the camera. This represents only 20 duction on a CRT. For some appUcations this may not be the 

a sUght conqiromise since the leas does not contribute desired color reproduction goal Modifications to the method 

significantly to variations in color reproduction perfor- ^ ^ achieve a preferred color 

mance reproduction goal by taking into account such factors as 

The present invention has been described thus fer with ^v^^on and mare perceptuaUy uniform color 

regard to a series of preferred embodiments outlining the . . , . « . , 

location of the color-correction matrix coeffidents within i^vendon has been described with reference to a 

the camera as wdl as thdr application in the image pro- Preferred embodiment. However, it will be appreciated that 

cessing path. FIG. 7 illustrates a general method for obtain- variations and modifications can be effected by a person of 

ing these coeffidents. A color chart 72 containing colors sbU m tiic art without departing from the scope of 

representative of the expected range of real world colors invention, 

provides the basis for the coeffidents calculation process. An PARTS LIST 

example of such a chart is the well known Macbeth CoIot ^« ™ . 

rh^rirer 10 Elcctromc camera 

. ^ ^ . , . ^ 11 Electronic scanna 

A necessary &st step mvolves measurement of the spec- 33 Image processing external to camera (peripheral digital 

tral characteristic (SjJ of the illuminant 74 as well as processor) &™ 

measurement of the spectral characteristic (Ri^) of each 13 laterfecc cable 

color patdi of the color chart 72. CIE tristimulus values Digital interface 

(XYZ), describing the location of a particular color patch in ^5 j^^^^^^^ ^ removable 

the 3-dimensional XYZ color space, may then be computed ^ reader 

from the measured spectral data as described in the afore- Color CRT displav 

mentioned ODE publication 15.2 (1986) Colonmetry— ^g Printer color 

Second Edition on pages 22-23. This set of XYZ values Color mint 

becomes tiie colorimctric aims for the camera. Keyboard 

The electronic camfira 10 is used to capture an image of 45 20 Optical sub-assembly 

the color chart 72 under the specified illuminant 74. RGB 22 Lens 

camera signals representative of the captured color chart 24 Infra-red cutoff filter 

image are next subjected to a normalization process 78 to 26 Blur filter 

provide RGB signals which vary linearly with scene lumi- 28 CCD Imager 

nance. The normalization process 78 may include removal 50 30 Color filter array (CFA) 

of the camera gamma/knee characteristic as well as black- 32 Scene 

level, white-balance and exposure errors. 34 Camera video pre-processing section 

linear RGB signals are transformed to a set of color- 36 Color-corrertion matrix coefficient memory on optical 

corrected ROB signals by color-correction matrix transfer- subassembly 

mation 79. Initially this matrix is set equal to the identity 55 38 Color-correction matrix coefficient memory in camera 

matrix. The coefficients are subsequentty adjusted in an 40 Color-correction matrix transformation 

iterative fashion by a regression process 80 until the average 50 Post-processing section 

color error for all color patches of the color chart 72 is 72 Color chart 

reduced to a predetermined level. 74 Uluminant 

Color-corrected RGB signals from color-correction 60 76 XYZ calculation process 

matrix transformation 79 are retransformed to a set of QE 78 Normalization process 

XYZ signals by CRT phosphor matrix transformation 84. 79 Color-correction matrix transftjrmation 

These signals represent the colors whidi would appear on 80 Regression process 

the face of a reference CRT when presented with the 82 Color error calculation process 

color-corrected RGB signals from color-correction matrix • 65 I daim: 

transformation 79. It would be understood by someone 1. A digital imaging device for capturing an image and 

skilled in the art that these color-corrected signals would first generating a color signal from the image for applicsdlon to 
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an ou^ut device having specific color sensitivities, said 
imaging device further being one of many devices cf the 
same type useful with the output device, said digital imaging 
device coxi^iising: 
a color sensor for capturing the image and generating the 
color signal from the captured image, said color sensor 
having predetCTiined spectral sensitivities; 
an optical section having predetermined spectral 
characteristics, said optical section interposed in image 
light from die image directed to the color sensor 
thereby imparting the predetermined spectral charac- 
teristics to the image light the combination of the 
spectral sensitivities of the color sensor and tibe spectral 
characteristics of the optical sertion uniquely distin- 
guishing the imaging device from other imaging 
devices of the same type; and 
a set of matrix coefficients uniquely determined for the 
imaging device in ordex to generate an optimized color 
signal, said matrix coef&dents correcting the spectral 
sensitivities of the color sensor and the spectral diar- 
acteristics of the optical section for the color sensitivi- 
ties of the ou^ut device. 

2. An imaging device as claimed in daim 1 in which the 
optical section includes a lens for directing the image light 
from the image upon the color sensor, said lens having a 
predetermined lens spectral characteristic, and wherein the 
matrix coefficients correct the lens spectral characteristic for 
the color sensitivities of the ou^ut device. 

3. An imaging device as claimed ia daim 1 in which the 
optical section indadcs a blur filter for spatially low pass 
filtering the image light directed upon the color sensor, said 
blur filter having a predetermined spectral characteristic, and 
wherein the matrix coefifidents correct the spectral charac- 
teristic for the color sensitivities of the output device. 

4. An imaging device as claimed in daim 1 in which the 
optical section indudes an in&ared cutoff filter for filtering 
the image light directed upon the cola: sensor, said infrared 
cutoff filter having a predetermined infrared spectral 
characteristic, and wherein the matrix coeffidents correct 
the infrared spectral characteristic for the color sensitivities 
of the ou^ut device. 

5. An imaging device as claimed in daim 1 wherein fiie 
color sensor indudes a color fllto- an:ay for color filtering the 
image light directed upon the color sensor, said color filter 
array having a predetermined color filter spectral 
characteristic, and wherein the matrix coeffidents correct 
the color filter spectral characteristic for the color sensitivi- 
ties of the display device. 

6. An imaging device as claimed in claim 1 wherein the 
imaging device comprises a digital camera. 

7. An imaging device as claimed in daim 1 wherein the 
imaging device con^irises a digital scanner. 

8. An imaging device as claimed in claim 1 wherein the 
ou^ut device comprises a display device. 

9. An imaging device as claimed in claim 1 wherein the 
output device comprises a printing device. 

10. An imaging device as claimed in daim 1 further 
comprising a color processing section for inq)lementing a 
matrix correction on the odor signal in order to generate the 
optimized color signal, said color processing section using 
the set of matrix coeffidents that are uniquely determined for 
the imaging device in order to generate tiie optimized color 
signal 

11. An imaging device as daimed in claim 1 in which the 
q)tical section and the set of matrix coeffidents are induded 
on a sub-assembly that is removable from the digital imag- 
ing device for purpose of so^dng and repair of the imaging 
device. 
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12. An imaging device as daimed in daim 1 in which the 
ou^ut device is a reference device, and said matrix coeffi- 
dents correct the spectral sensitivities of the color sensor 
and the spectral characteristics of the optical section for the 

5 reference color sensitivities of tiic output device. 

13. An dectronic imaging system induding a computer 
useful with an imaging device as claimed in daim 1, 
wherein the computer comprises a color processing section 
for in^lementing a matrix correction on the cdor signal 
using the set of matrix coeffidents in order to generate the 
optimized color signal, and the imaging device provides the 
color signal together with tiie matrix coeffidents to the 
computer. 

14. An imaging device as daimed in claim 1 in which the 
optical section indudes a lens for directing the image light 
from the image upon the cdor sensor, said lens being 
removable from the imaging device and having a predeter- 
mined reference lens spectral characteristic, and wherein the 
matrix coeffidents correct the reference lens spectral char- 
acteristic for the color sensitivities of the output device. 

15. An imaging device as daimed in claim 1 in which the 
output device is represented by a connection space, and said 
matrix coeffidents are part of a device profile for correcting 
the spectral sensitivities of the color sensor and the spectral 

2j characteristics of the optical section for the color sensitivi- 
ties of the connection space. 

16. A digital camera for capturing an image and generat- 
ing a color signal from the image for input to an intended 
display device having specific color sensitivities, said cam- 
era further being one of many cameras of the same type 
useful with the display device, said camera comprising: 

a color sensor for capturing the image and generating the 
color signal from the captured image, said color sensor 
having predetermined spectral sensitivities defining the 
2^ color response of the color sensor; 

a lens for directing image light from the image upon the 
color sensor, said lens having a predetermined lens 
spectral chamcteristic; 

an infrared cutoff filter having a predetermined infrared 
40 Spectral characteristic for filtering the image light 
directed upon the color sensor, 

the combination of said spectral sensitivities of the color 
sensor and the spectral characteristics of the lens and 
the infrared cutoff filter uniquely distinguishing the 
A5 digital camera from other digital cameras of the same 
type; and 

a matrix storage containing a set of matrix coeffidents 
uniqudy determined for the camera in order to generate 
an optimized color signal, said matrix coeffidents cor- 
se recting the spectral sensitivities of the color sensor and 
the spectral characteristics of the lens and the infrared 
cutoff filter for the color sensitivities of the intended 
display device. 

17. A digital camera as daimed in daim 16 further 
35 comprising a blur filter having a predetermined low pass 

spatial characteristic for low pass filtering the image tight 
directed upon the cdor sensor, and wherein the matrix 
coeffidents further correct the spectral characteristic of the 
blur filter for the color sensitivities of the intended display 
60 device. 

18. A digital camera as claimed in claim 16 wherein the 
color sensor includes a color filter array for color filtering the 
image lig}it directed upon the color sensor, said cdor filter 
array having a predetermined color filter spectral 

65 diaracteristic. and wherdn the matrix coeffidents correct 
the spectral characteristic of the cdor filter array for the 
color sensitivities of the intended display device. 



02/04/2004, EAST Version: 1.4.1 



5,668,596 



U 



12 



19. A digital camera as claimed in claim 16 further 
comprising a color processing section for implementing a 
matrix coirecdon on the color signal in order to generate the 
optimized color signal, said color processing section using 
the set of matrix coeMcients in the matrix storage that are 
uniquely determined for this digital camera in order to 
generate the optimized color signal. 

20. An electronic imaging system induding a computer 
us^ul with a digital camera as claimed in claim 16, whexein 
the computer comprises a color processing section for 
in^lementing a matrix correction on the color signal using 
the set of noatrix coefficients in the matrix storage in order 
to generate the optimized color signal, and the digital camera 
provides the color signal together with the matrix coeffi- 
cients to the coiiq>utcr. 

21. A digital camera for capturing an image and generat- 
ing an optimized colcr signal from the image f cr input to an 
intended display device having speciiic color sensitivities, 
said camera further being one of many cameras of the same 
type useful with the display device, said camera comprising: 

a color sensor comprising a color filter array and a 
photosensor for capturing the image and generating a 
color signal from the captured image, said color sensor 
having predetermined spectral sensitivities defining the 
color response of a specific color sensor employed in 
the digital camera; 

an optical section induding at least a lens for directing 
image light from the image upon the color sensor and 
an infrared cuto£f filter for filtering the image light 
directed upon the color sensor, said optical section 
having optical spectral characteristics comprised of a 
specific lens spectral characteristic which together 
define the optical response of a specific optical section 
employed in the digital camera; 

the combination of said spectral sensitivities of the color 
sensor and the spectral characteristics of the optical 
section uniquely distinguishing the digital camera from 
other digital cameras of the same type; 

a memory containing matrix coeffidents uniqudy deter- 
mined for the camera in order to generate the optimized 
color signal, said matrix coefficients ejecting the 
spectral sensitivities of the color sensor and the spectral 
characteristics of the optical section for the color sen- 
sitivities of the intended display device, and 

a color processing section for implementing a matrix 
correction on the color signal using the matrix coeffi- 
cients in the memory in order to generate the optimized 
color signaL 

22. A digital camera as dairaed in claim 21 wherein said 
optical section further indudcs a blur filter for spatially low 
pass filtering the image ligjit directed upon the color sensor, 
said blur filter having a predetermined spectral 
diaracteristic, and wherein the matrix coeffidents fiirther 
correct the spectral diaracteristic of the blur filter for the 
color sensitivities of die intended display device. 

23. A digital camera for cs^turing an image and generat- 
ing a color signal from the image for input through an 
external processor to an intended display device having 
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color signal from the captured image, said color sensor 
having predetomiined spectral sensitivities defining the 
color response of the sensor, 

an optical section induding at least a lens for directing 
image light from the image upon the color sensor and 
an infrared oitoff filter for filteiing the image lig;ht 
directed upon die color sensor, said optical section 
having optical spectral characteristics comprised of a 
specific lens spectral characteristic which together 
define the optical response of a specific optical section 
employed in the digital camera; 

the combination of said spectral sensitivities of die color 
sensor and the spectral characteristics of the optical 
section uniquely distinguishing the digital camera from 
other digital cameras of the same type; 

a memory containing matrix coeffidents uniquely deter* 
mined for the camera in order to generate the optimized 
color signal, said matrix coeffidents correcting the 
spectral sensitivities of the color sensor and the spectral 
characteristics of the optical section for the color sen- 
sitivities of the intended display device; and 

means for providing the color signal and the matrix 
coeffidents to the external processor. 

24. A digital camera as claimed in claim 23 wherein said 
optical section further indudes a blur filter for spatially low 
pass filtering the image light directed upon the color sensor, 
said blur filter having a predetermined spe<tral characteristic 
controlling the response of the q)tical section, and wherein 
the matrix coeffidents fiirther correct the spectral character- 
istic of the blur filter for the color sensitivities of the 
intended display device. 

25. A digital camera for capturing an image and generat- 
ing a color signal from the captured image, said camera 
comprising: 

a main assembly for housing the camera; and 

a removable subassembly induding a color sensor having 
specific color sensitivities for capturing the image and 
generating the color signal, an optical section including 
at least a lens and an infrared filter having respective 
lens and cutoff spectral characteristics, and a memory 
device containing matrix coeffidents for color correct- 
ing the spectral sensitivities of the color sensor and the 
spectral diaracteristics of the optical section for the 
color sensitivities of the display device; 

a signal processing section for processing the color signal 
generated by the color sensor; 

dectiical connecting means for replaceably int^connect- 
ing the signal processhig section and the subassembly; 
and 

a color processing section for inq)lementing a matrix 
correction on the color signal using the matrix coeffi- 
dents in the memory device in order to generate an 
optimized color signal. 

26. A digital camera for capturing an image and outputting 
a color image signal to an external processor, said external 
processor including a color processing section for inq)le- 
menting a matrix correction on the color image signal in 



specific color sensitivities, said external processor induding 50 order to generate an optimized color signal from the cap- 



a color processing section for implementing a matrix cor- 
rection on the color signal in order to generate an optimized 
color signal, said camera farther being one of many cameras 
of the same type useful with the display device, said camera 
comprising: 

a color sensor comprising a color filter array and a 
photosensor for capturing the image and generating the 
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tured image, said camera con^Trlsing: 
a main assembly for housing the camera; 
a removable subassembly induding a color sensor having 
specific color sensitivities for c^turing the image and 
generating a color signal, an optical section induding at 
least a lens and an infrared filter having respective lens 
and cutoff spectral diaracteristics, and a memory 
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device containmg matrix coefficients for color cairect- 
ing the spectral sensitivities of the color sensor and the 
spectral diaracteristics of the q>tical section for the 
color sensitivities of the display device; 

a signal processing section for processing the color signal ^ 
generated by the color sensor; 

electrical connecting means for replaceably interconnect- 
ing the signal processing section and the subassembly; 
and 

means for providing the color image signal and the matrix 

coefficients to the external processor, 
27. A digital camera for c^turing an image and generat- 
ing a color signal from the image for iiq)Ut to an ext^al 
processor operative in a connection space haying specific 
color sensitivities defined by a set of color matching 
functions, said external processor including a color process- 
ing section for inq)lementing a matrix correction on the 
color signal in crder to generate an optiinizcd color signal, 
said camera further being one of many cameras of the same 
type, said camera comprising: 
a color sensor convulsing a color filter array and a 
photosensor for capturing the image and generating the 
color signal from toe captured image, said color sensor 
having predetermined spectral sensitivities defining fee 25 
color response of the sensor; 
an optical section including at least a lens for directing 
image light from the image upon the color sensor and 
an infrared cutoff filter for filtering the image light 
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directed upon the color sensor, said q)tical section 
having optical spectral characteristics conqiriscd of a 
specific lens spectral characteristic which together 
define the optical response of a specific optical seoion 
enq>loyed in the digital camera; 
the combination of said ^ectral sensitivities of the color 
sensor and the spectral characteristics of the optical 
section uniquely distinguishing the digital camera from 
other digital cameras of the same type; 
a memory containing matrix cocfBdcnts uniquely deter- 
mined for the camera in order to generate the optinuzed 
color signal, said matrix coefficients being part of a 
device profile for correcting the spectral sensitivities of 
the color sensor and the spectral characteristics of the 
optical section for the color sensitivities of fee connec- 
tion space; and 
means fa* providing fee color signal and fee niatrix 

coefficients to fee external processor. 
2S. A digital camera as claimed in claim 27 wherein said 
optical section furfeer includes a blur filter for spatially low 
pass filtering fee image light directed upon fee color sensor, 
said blur filter having a predetermined spectral characteristic 
controlling fee response of fee optical section, and wherein 
fee matrix coefficients furfeer correct fee spectral character- 
istic of fee blur filter for fee color sensitivities of fee 
connection space. 

Id *^ 4* ♦ # 
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